Electronic photography system

ABSTRACT

An electronic photography system which displays an image shot by an electronic image capturing unit. The electronic image capturing unit includes an optical path, an image pickup for converting a focused image to electronic image data, an information inputting device for adding attribute data to the image data, and a storage for storing the image data and attribute data in mutually associated relationship. The system further includes the unit for classifying the image data on the basis of the attribute data for grouping the image data into album groups, and selecting, the album group to display the image data included in the selected album.

REFERENCE TO EARLIER FILED APPLICATION(S)

This application is a continuation of the following earlier filedapplication(s): 08/325,095 filed Oct. 17, 1994, issued as U.S. Pat. No.5,796,428.

BACKGROUND OF THE INVENTION

The present invention relates to a so-called electronic photographysystem which can electronically record images on such a memory device asa semiconductor memory or a magnetic disk without using any films.

Silver halide film is usually used for photograph. The exposures aredeveloped and printed on a photographic paper for its appreciation.There exists a technique for displaying images printed on a photographicpaper on a TV display. For example, disclosed in JP-A-3-261935 is asystem in which picture images printed on a photographic paper aredisplayed on a monitor device together with information associated withthe picture images, such as shooting days and shutter speeds.

Meanwhile, an electronic still image capturing unit has been put inpractical use in these years. This image capturing unit is designed toelectronically record picture images on a memory device such as asemiconductor memory or a magnetic disk without using any films. In areproduction mode of the image capturing unit, the recorded pictureimages can be reproduced on an external TV display or can be transferredto a computer to be used for desk-top publishing (DTP).

Photographs for use by a single individual have been rapidly increasedlately. Typically, pictures taken by an individual amount to severaltens a year. Thus, several hundreds of pictures are produced in afamily. In particular, a newly-wedded couple, a family having a newlyborn baby or a person who goes abroad, has many chances of takingpictures and thus the number of pictures taken per year amounts nearlyto 500.

It is highly troublesome to re-arrange and keep these pictures, whichresults in may cases in that such pictures are merely inserted into apocket-type album or kept in different places. For this reason, evenwhen it is desired to find some pictures, such finding is difficult. Inaddition, when pictures are kept in different places, such pictures tendto be lost undesirably.

For the purpose of re-arranging and keeping pictures, in general, thereis used such an album of a type that pictures are bonded on layoutsheets. In this case, it is also possible to divide the picturesaccording to the theme or subject matter or to add some comments tothem. However, rearranging and keeping pictures requires a lot oflabors, including classifying and rearranging the pictures and arrangingthe pictures on layout sheets in a beautiful and balanced layout.Further, such comments as associated dates and places are added to thepictures. When an user after taking pictures immediately conducts theabove works, the works might not impose so burdensome feeling on theuser. However, once such pictures are left alone and accumulated as notrearranged, it becomes troublesome to rearrange them. And such picturescontain many pictures which are not taken well, that is, out of focus orhave improper exposure.

It is an object of the present invention to provide an imagerecording/reproducing system which can eliminate the above problems inthe prior art and can easily rearrange and keep photographic images andalso can display the images for appreciation.

SUMMARY OF THE INVENTION

In order to solve the above problems, in accordance with the presentinvention, there is provided an image recording/reproducing system whichcomprises an image capturing unit, an image storage/display unit andmeans for applying attribute data to data of a picture image at the timeof shooting the picture image is provided in the image capturing unit.Further, means for displaying the picture image on the basis of theattribute data in a picture display mode is provided in the imagestorage/display unit. The image capturing unit is based on such a systemthat a device such as a charge coupled device (CCD) is employed in placeof silver halide film to capture the image data in the image capturingunit in the form of electronic data. Since the attribute data is madealso in the form of electronic data, the image and attribute data can besystematically handled. The image storage/display unit includes a datastorage for storing the image data therein and an image display forelectronically displaying the image data in the form of an albumthereon.

In accordance with first one of preferable aspects of the presentinvention, means for applying a date and a time of capturing the imagedata to the picture image data as the attribute data is provided in theimage capturing unit. Further, the image storage/display unit classifiesand displays the image data on the basis of this attribute data.

In accordance with second one of the preferable aspects of the presentinvention, an attitude detector for detecting an attitude of an imagepickup is provided in the image capturing unit, and means for applyingas attribute data to the image data the attitude of the image pickup atthe time of capturing the image data is also provided in the imagecapturing unit. Further, the image storage/display unit changes anorientation of the image data to be displayed on the basis of theattitude attribute data.

In accordance with third one of the preferable aspects of the presentinvention, a shooting place input part is provided in the imagecapturing unit, and means for applying the picture shooting place to thepicture image data as attribute data is also provided in the imagecapturing unit. Further, the image storage/display unit classifies anddisplays the image data on the basis of the shooting place attributedata.

In accordance with fourth one of the preferable aspects of the presentinvention, a image input part for inputting an image of the operator ofthe system is provided in the image capturing unit, and means forappending the image of the operator to the picture image data as anoperator attribute data is also provided in the image capturing unit.Further, the image storage/display unit classifies and displays theimage data on the basis of the attribute data.

In accordance with fifth one of the preferable aspects of the presentinvention, means for shooting sub picture images at times in thevicinity of the moment that a main picture image is shot and applyingthe sub picture image data to the main picture image data as attributedata of the main image data. Further, in the image storage/display unit,a desired image is selectively displayed among the main or sub pictureimage data.

In accordance with sixth one of the preferable aspects of the presentinvention, there is provided in the image capturing means for shootingsub images with shifted focuses at times in the vicinity of the momentof shooting a main picture image and applying the sub image data to themain picture image data as its attribute data. Further, in the imagestorage/display unit, a desired image is selectively displayed among themain or sub picture image data.

In accordance with seventh one of the preferable aspects of the presentinvention, there is provided in the image capturing means for shootingsub images with shifted apertures at times in the vicinity of the momentof shooting a main picture image and applying the sub image data to themain picture image data as its attribute data. Further, in the imagestorage/display unit, a desired image is selectively displayed among themain or sub picture image data.

In accordance with eighth one of the preferable aspects of the presentinvention, there is provided in the image capturing means for recordingvoice data of a shooting place at times in the vicinity of the moment ofshooting a picture image and applying the voice data to the pictureimage data as its attribute data. Further, when it is desired to displaythe picture image data, the image storage/display unit reproduces thevoice data of its attribute data.

At the time of shooting the picture image, the attribute data on thepicture image is applied to the picture image data. These picture andattribute data are temporarily stored in the storage within the imagecapturing unit and then transferred to the image storage/display unit.In the image storage/display unit, the received picture and attributedata are once stored. Further, the image storage/display unit generatesalbum data for classification and display on the basis of the attributedata. When it is desired to display the picture data, the data isclassified and displayed in the form of an album on the basis of theattribute and album data. Further, when image display is desired, thedisplay format is changed on the basis of the attribute data.

Upon arranging pictures, it is often that the pictures are classifiedaccording to themes such as, athletic meeting or travel abroad. However,as long as the pictures are treated by an individual, the pictures canbe arranged on a time series basis. In other words, it is impossible tohave such pictures of the same date on, e.g., athletic meeting andtravel abroad. Accordingly, when the pictures are arranged in itsshooting date or time order, the pictures can also be automaticallyclassified according to themes.

In the first aspect of the invention, each time a picture image is shot,its date and time are previously recorded as attribute data. The imagestorage/display unit automatically classifies and displays the imagedata in the form of an album on the basis of the attribute data andalbum data generated based on the attribute data.

A picture image has vertical and horizontal orientations. Thus, when itis desired to display such pictures in the form of an album, theorientations of pictures must be aligned so that the pictures can bedisplayed in their erecting form.

In the second aspect of the invention, when a picture image is shot, anattitude of the image pickup is previously recorded as its attributedata. The image display displays such pictures thereon in such a mannerthat the pictures are automatically displayed in their erecting form.

Although picture classification has been carried out based on the dateand time attribute data in the first aspect, it is also considered toclassify such pictures on the basis of their shooting places.

In the third aspect, when a picture image is shot, its shooting place ispreviously recorded as its attribute data. The image storage/displayunit automatically classifies and displays such pictures on the basis ofthe shooting place attribute data and album data generated based on theattribute data. For example, when it is desired to make an album oftravel abroad, an entire album is produced in accordance with the firstembodiment and pictures in the album are classified according to theshooting places, e.g., streets by means of the third embodiment.

In the case where pictures are taken by different members in a familyand left mixed, albums for the individual photographers can be made. Inthe fourth aspect, when a picture image is shot, its photographer ispreviously recorded as its attribute data. The image storage/displayunit automatically display such pictures in the form of each of theindividual photographer albums on the basis of the attribute data andalbum data generated based on the attribute.

There often occurs such a case that some of persons as subjects closetheir eyes at the moment that the user depresses the shutter release,that is, missing of a good shutter-release timing. In the fifth aspect,sub picture images at times before and after the moment of the shutterrelease are stored and applied to the main picture image data ofdepression of the shutter release. When the main picture image taken atthe moment of the shutter release is not acceptable, the imagestorage/display unit selects suitable one from the sub picture imagesand records in the album data indicative of the selection of the subpicture image in place of the main one. Thus, in the next display, thesuitable sub picture image is displayed based on the album data.

Some of pictures are sometimes taken with improper focus. In the sixthaspect, after a main picture is taken, sub picture images are taken withfocuses shifted from the focus of the main picture image and added tothe main picture image data as its attribute data. When the main pictureimage is taken with improper focus, the image storage/display unitselects suitable one of the sub picture images with focuses shifted andrecords data indicative of the selection of the suitable sub pictureimage in the album data in place of the main picture image. Thus, whenthe image is displayed in next time, the suitable sub picture image isdisplayed based on the album data.

Some of pictures are sometimes taken with improper apertures. In theseventh aspect, after a main picture is taken, sub picture images aretaken with apertures shifted from the aperture of the main picture imageand added to the main picture image data as its attribute data. When themain picture image has an improper aperture, the image storage/displayunit selects suitable one of the sub picture images and records dataindicative of the selection of the suitable sub picture image in thealbum data in place of the main picture image. Thus, when the image isdisplayed in next time, the suitable sub picture image is displayedbased on the album data.

Pictures dealt with in the present invention are still pictures.However, when ambient sound at the time of shooting the picture or avoice comment is added to the picture, the picture becomes moreimpressive and fascinating when reproduced later. In the eighth aspect,ambient sound ranging between the before and after the shutter releaseis stored and added to the picture image data as its attribute data.When the picture image is displayed, the image storage/display unitreproduces the voice data as the attribute data together with thepicture image.

The first to eighth aspects can be carried out respectivelyindependently or in combination.

In accordance with other aspect of the present invention, there isprovided an image display method for displaying an image shot by anelectronic image capturing unit, the image capturing unit comprising anoptical imaging system, image pickup means for converting a focusedimage to electronic image data, data application means for applyingattribute data to the image data, and storage means for storing thereinthe image data and attribute data in mutually associated relationship;the method comprising the steps of classifying the image data on thebasis of the attribute data for album grouping, and selecting, in animage display mode, the image data on every album basis to display aselected image data. In general, the attribute data include a picturenumber for uniquely designating the image.

When displaying the image, the image and attribute data are collectivelytransferred from the storage means of the electronic image capturingunit to the second storage of the display device, a plurality of theimage and attribute data collectively transferred are grouped into asingle file list, and a file number for identifying a file is added tothe file list.

It is practical that an album includes a plurality of picture lists andeach of the picture lists has at least the file number and picturenumber. When displaying pictures in each album, the image data areautomatically retrieved from the film list and displayed on the display.

Further, an album includes a plurality of pages and the picture listsare grouped on every page basis. Thus the user can see pictures on everypage basis with the same feeling as to actually see a physical album.

At the time of displaying the images, a plurality of the image data areretrieved from a file list on the basis of the file number and picturenumber of the picture list is displayed on a display with respect toeach page, at which time the image data to be displayed on the screenare processed on the basis of control data contained in the picturelist. More in detail, the control data includes at least one of trimmingcontrol data for designation of image trimming, scaling control data forenlargement or reduction of the image and display position control datafor control of a display position of the image in the display screen.Thus, the user can rearrange pictures and change the size or orientationof the pictures in each page according to user's preference.

The attribute data includes at least one of image shooting conditiondata, image shooting time data and user input identification data, thefilm number and picture number are selectively extracted from the filelist stored in the second storage means on the basis of the data to forma picture list of a pair of the extracted file and picture numbers, anda plurality of the picture lists form the album. Thus the user can editand classify the albums according to themes inputted by an user.

In accordance with still other aspect of the present invention, there isprovided an electronic image capturing unit which comprises an opticalimaging system, image pickup means for converting a focused image toelectronic image data, image capturing control means for shooting ashooting subject by a plurality of times at different time points toobtain a plurality of image data, an operator for performing operationover one of the plurality of image data as reference data and the otherimage data to obtain an operation result, and storage means for storingtherein the operation result as attribute data.

In this connection, it is desirable that the shooting of a subject bythe plurality of times is carried out under changed shooting conditionsand that the operator comprises a differential operator for calculatinga difference between the reference data and the other image data andstoring the difference. In addition, it is practical that the referenceand the attribute data are stored in the storage means in a set. Withsuch an arrangement, picture shooting can be facilitated without anyshooting failure while eliminating the need for the storage to increaseits memory capacity.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an image recording/reproducing system inaccordance with a first embodiment of the present invention;

FIG. 2 is a detailed block diagram of an image pickup part in an imagecapturing unit in the system of FIG. 1;

FIG. 3 is a plane view of an example of appearance of the imagecapturing unit in FIG. 1;

FIG. 4 is a plane view of an example of appearance of an imagestorage/display unit in the system of FIG. 1;

FIG. 5 is a plane view of an example of display of the imagestorage/display unit in FIG. 1;

FIG. 6 is a plane view of another example of the display of the imagestorage/display unit;

FIG. 7 is a plane view of a further example of the display;

FIG. 8 is a plane view of yet a further example of the display;

FIG. 9 is a plane view of yet another example of the display;

FIG. 10 is a structure of picture data in the image capturing unit;

FIG. 11 is a detailed structure of a picture data;

FIG. 12 is a chart of examples of attribute data in the picture data;

FIG. 13 is a structure of film list data;

FIG. 14 is a chart of examples of a film header in the film list data ofFIG. 13;

FIG. 15 is a structure of album list data;

FIG. 16 is a detailed structure of an album header in the album listdata;

FIG. 17 is a structure of page list data;

FIG. 18 is a detailed structure of a picture list data of the page listdata;

FIG. 19 is a flowchart showing procedures for generating an album list;

FIG. 20 is a flowchart showing procedures for displaying an album listin the presence of the album list;

FIG. 21 is a table showing examples of the picture list;

FIG. 22 is a table showing examples of the page list;

FIG. 23 is a table showing an example of the album header;

FIG. 24 is a plane view of an example of a contents display screen;

FIG. 25 is a plane view of an example of display of the screen;

FIG. 26 is a block diagram of an image capturing unit in an imagerecording/reproducing system in accordance with a second embodiment ofthe present invention;

FIG. 27 is a structure of an example of picture data;

FIG. 28 is a table showing examples of attribute data in the picturedata of FIG. 27;

FIG. 29 is an example of a picture list;

FIG. 30 is an example of a display screen;

FIG. 31 is a block diagram of an image capturing unit in an imagerecording/reproducing system in accordance with a third embodiment ofthe present invention;

FIG. 32 is an example of picture data;

FIG. 33 is a table showing examples of attribute data in the picturedata of FIG. 32;

FIG. 34 is an example of a picture list;

FIG. 35 is a block diagram of an image capturing unit in an imagerecording/reproducing system in accordance with a fourth embodiment ofthe present invention;

FIG. 36 is an example of picture data;

FIG. 37 is a table showing examples of attribute data in the picturedata of FIG. 36;

FIG. 38 is an example of a picture list;

FIG. 39 is a block diagram of an image capturing unit and an imagestorage/display unit in an image recording/reproducing system inaccordance with fifth, sixth and seventh embodiments of the presentinvention;

FIG. 40 is a diagram for explaining the operation of the fifthembodiment;

FIG. 41 is a diagram for explaining the operation of the sixth andseventh embodiments;

FIG. 42 is a structure of a picture data;

FIG. 43 is an example of a picture list;

FIG. 44 is a block diagram of an image capturing unit and an imagestorage/display unit in an image recording/reproducing system inaccordance with an eighth embodiment of the present invention;

FIG. 45 is a diagram for explaining the operation of the eighthembodiment;

FIG. 46 is a structure of a picture data; and

FIG. 47 is an example of a picture list.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

A first embodiment of the present invention will be explained. Referringto FIG. 1, there is shown a block diagram of an electronic photographysystem in accordance with the first embodiment of the present invention.The illustrated electronic photography system comprises a imagecapturing unit 101 and an image storage/display unit 102.

The image capturing unit 101 captures image and temporarily saves thedata of the image before the data is sent to the image storage/displayunit 102. More specifically, an image pickup part 103 captures the imagefrom outside the image capturing unit and converts the captured datainto electronic picture image data. The image pickup part 103 then sendsthe converted electronic data to a storage unit 104 to be storedtherein. The storage unit 104 comprises a semiconductor memory, amagnetic disk device, a floppy disk device or an optical disk device.Optimumly used as the storage unit 104 is an IC card provided with asemiconductor memory and with a backup power source, since it isdesirable that the storage unit 104 has no mechanically movable partsand the storage unit 104 is only required to temporarily storeinformation until the information is sent to the image storage/displayunit. A command input part 105 is used to input a command to be given tothe image capturing unit 101 through a shutter for determination ofcapture timing of picture image data. An output of the command inputpart 105 is sent to a image capturing unit controller 106 where acontrol signal for controlling the image capturing unit 101 isgenerated. A clock 107 outputs a date (year, month and day) and time.The date and time when picture image data is captured are used as anattribute data of the picture image data, so that the attribute data isstored in the storage unit 104 together with the picture image data.

The image storage/display unit 102 receives the picture image data andattribute data from the image capturing unit and displays the picturedata thereon. More in detail, the image storage/display unit 102 acceptsdata from the image capturing unit through an interface 108. In the casewhere the storage unit 104 of the image capturing unit 101 cannot beremoved from the image capturing unit unlike a magnetic disk, the imagestorage/display unit 102 is connected directly to the image capturingunit 101 to read out the picture and attribute data from the magneticdisk via the interface. In the case where the storage of the imagecapturing unit is such a removable medium as an IC card, a floppy diskor an optical disk, on the other hand, the interface 108 of the imagestorage/display unit 102 may be replaced by a corresponding type ofdrive unit. The picture and attribute data received from the imagecapturing unit is saved in a storage unit 109. The storage unit 109 ofthe image storage/display unit 102 preferably comprises a magnetic tapedevice, a magnetic disk device or an optical disk device, since thestorage unit 109 is required to save therein the picture and attributedata semi-permanently and also required to have a large capacity.Because of its fast accessing time and exchangeable medium, the opticaldisk device is most preferable. A command input part 110 is used toenter a command to the image storage/display unit 102 with use of aswitch or a pen tablet. An output of the command input part 110 is sentto a storage/display controller 111 where a control signal forcontrolling the image storage/display unit 102 is generated. Album datais created on the basis of the picture and attribute data received atthe storage unit 109. The album data will be described later. In adisplay controller 112, display data is created based on the attributeand album data and sent to a display 113. The display 113, whichdisplays the picture data thereon, comprises, e.g., a color liquidcrystal display (LCD). Of course, the display 113 may comprises a CRTdisplay in place of the CCD or a monitor may be provided outside theimage storage/display unit 102, as necessary.

Data transfer from the image capturing unit 101 to the imagestorage/display unit 102 is not necessary to be carried out every time apicture image is acquired. That is, picture images can be continuallyacquired to such an amount that corresponds to the possible memorycapacity of the storage unit 104 of the image capturing unit 101, andthe accumulated picture can be collectively transferred to the imagestorage/display unit 102. Although the image capturing unit 101 has beenprovided separately from the image storage/display unit 102 in FIG. 1,the image capturing unit 101 may be provided integral with the imagestorage/display unit 102, as a matter of course. In the latter case, thestorage unit 104 for temporary memorization of data in the imagecapturing unit 101 becomes unnecessary and the picture and attributedata are written in the storage unit 109 of the image storage/displayunit 102.

Shown in FIG. 2 is a detailed diagram of the image pickup part 103 ofthe image capturing unit 101 in FIG. 1. More specifically, incidentlight is passed through a stop or diaphragm 201 and a lens 202 to forman image on a charge coupled device (CCD) 203. A diaphragm controller204 changes an aperture size of the diaphragm 201 on the basis of acommand from the image capturing unit controller 106 of FIG. 1. A focuscontroller 205 moves the lens 202 on the basis of the command from theimage capturing unit controller 106. The diaphragm 201 and the lens 202are automatically controlled by the image capturing unit controller 106of FIG. 1 so that an image having a suitable exposure is focused on theCCD 203. A CCD controller 206, on the basis of the command from theimage capturing unit controller 106 of FIG. 1, transfers the picturedata to the storage in a form of electric signal. The electric signal ofthe picture data is sent from the CCD 203 also to an electric viewfinder (EVF) 207 to allow an operator to visually observe the picturedata.

FIG. 3 shows an example of appearance of the image capturing unit in thepresent invention. The illustrated image capturing unit has a shapesimilar to an image capturing unit using an ordinary silver halide film.A lens 301 of the image capturing unit provided in its front side is thesame as the lens 202 shown in FIG. 2. The lens 301 is driven in responseto the operation of a zoom button 302 to change a picture imagecapturing range. A shutter is of a two step type which comprises a firstshutter release 303 to be firstly pushed and a second shutter release304 to be secondly pushed subsequent to the first shutter release 303. Aliquid crystal panel 305 of the image capturing unit provided in itsrear side uses the output of the EVF 207 of FIG. 2 to display a pictureimage being shot thereon. The liquid crystal panel 305 is also used as adisplay panel for inputting command into the image capturing unit. Thecommand input is carried out by an operator selecting a menu displayedon the liquid crystal panel 305 with use of an input button 306. Aconnector 307 is connected with an external cable when it is desired toexternally read out the picture and attribute data temporarily stored inthe storage unit 104 of the image capturing unit 101 in FIG. 1. When thestorage unit 104 of the image capturing unit 101 is of such a type thatsuch medium as floppy disk, optical disk or IC card can be extractedfrom the storage unit 104, the aforementioned data reading is carriedout by shifting the medium containing the data to a desired externaldevice.

FIG. 4 shows an example of appearance of the image storage/display unitin the present invention. The illustrated image storage/display unit,for the purpose of providing portability, has a liquid crystal panel 401and designed to have a document paper size corresponding substantiallyto A4 or LTR. A switch 402 is a start switch and all operations orcommands other than the starting operation are given through a pen inputdevice 403. Provided in the upper left and right sides of the liquidcrystal panel 401 are loudspeakers 404 to also provide a voice output.FIG. 4 is an example when an optical disk device is used as the storageunit 109 of the image storage/display unit 102 of FIG. 1, in which casean optical disk 405 is inserted into a side slot of the imagestorage/display unit. The image storage/display unit also has aconnector 406 which is connected with an external cable when it isdesired to read the picture and attribute data into the imagestorage/display unit from the image capturing unit. When the storageunit 104 of the image capturing unit 101 of FIG. 1 comprises an opticaldisk device, the shift of the picture and attribute data can be realizedby the user inserting its optical disk into the side slot of the imagestorage/display unit. That is, when the storage unit 104 of the imagecapturing unit 101 comprises a floppy disk device or IC card device andthe image storage/display unit also contains the corresponding type ofdevice, data shift can be realized without the external cable.

FIGS. 5 to 9 show examples of display screen of the imagestorage/display unit in the present invention. It is assumed that alloperations or commands to the display unit are given with use of the peninput device.

When the operation of the image storage/display unit starts, thereappears such a book-shelf type initial screen as shown in FIG. 5.Picture images are classified into an album 501 which is then arrangedin a book shelf 502. Such albums are generated according to an albumlist to be described later. When the user clicks an image capturing uniticon 503, this causes the image storage/display unit to be put in such acapture mode that the image storage/display unit can capture the pictureand attribute data from the image capturing unit. When the user clicks afile icon 504, this causes the image storage/display unit to be put insuch an edit mode that the user can edit a file list as an assembly orset of picture and attribute data. When the user clicks an album icon505 illustrated in the form of a white sheet, this causes the imagestorage/display unit to be put in such a mode that a new album can begenerated and a new album list is generated based on the file list. Thefile and album lists will be detailed later. When the user clicks an endicon 506, this causes the system to be turned off.

In FIG. 5, when the user clicks the shelf-back of desired one of albumsarranged in the book shelf, this causes the display screen to be changedto such a screen as shown in FIG. 6. Also displayed on the screen ofFIG. 6 are, in addition to a front cover 601 of the album, an edit toolicon 602, a book-shelf icon 603 and page-leafing icons 604 and 605. Inthis case, the edit tool icon 602 is previously set in its selectdisable mode. When the user clicks the book-shelf icon 603, this causesthe current screen to be returned to such an initial book-shelf screenas shown in FIG. 5. When the user clicks the page-leafing icon 604 or605, this causes the left or right page of the album to be leafed.

In FIG. 6, when the user clicks the page-leafing icon 604, this causessuch a contents screen 701 as shown in FIG. 7 to appear. The contentsscreen is made up of icons each having a pair of contents name and page.When the user clicks desired one of such icons, this causes the screento be skipped to the clicked page. Clicking the contents icon or thepage-leafing icon 604 causes such a picture screen 801 as shown in FIG.8 to appear.

The picture screen 801, immediately after the album list is generated,has pictures arranged in a preset array as shown in FIG. 8. This issufficient for usual picture appreciation. However, when the user clicksthe edit tool icon 602, the user can perform editing operation over thepicture images. Operations available in the edit mode include scaling(enlarging and reducing), rotation, trimming and moving of pictureimages, and writing of comments with use of a pen input device. Anexample of the screen of FIG. 8 after subjected to such editingoperations is shown in FIG. 9.

FIG. 10 shows a structure of data in the image capturing unit, in whicha plurality of picture data 1001 are sequentially stored in the storagein a shooting date order.

FIG. 11 shows details of one of the plurality of picture data 1001. Thepicture data 1001 is made up of image data 1101 indicative of the imagedata itself and attribute data 1102 indicative of data associated withthe image data. That is, the image data 1101 is the data itself of theimage captured by the image capturing unit, while the attribute data1102 is the data of attributes relating to the image. In the firstembodiment, the attribute data 1102 contains a picture number 1103applied to an associated picture in its shooting date order as well as ashooting year 1104, a shooting month 1105, a shooting day 1106 and ashooting time 1107 of the picture issued from the clock 107 of FIG. 1.

Examples of such attribute data alone as shown in FIG. 10 are shown inFIG. 12 in a table form.

When such picture data each having the image and attribute data as shownin FIG. 10 are accumulated by a predetermined amount in the storage unit104 of the image capturing unit 101 of FIG. 1, the image capturing unit101 transfers the accumulated data to the image storage/display unit102. The image storage/display unit 102, on the other hand, whenreceiving the picture data from the image capturing unit, generates sucha file list 1301 as shown in FIG. 13 on the basis of the receivedpicture data. The file list 1301 comprises a file header 1302 and aplurality of picture data 1001 which are the same as those shown in FIG.10. The file header 1302 comprises a file number 1303, a total picturenumber 1304 corresponding to the number of pictures contained in thefile list, date of the transfer such as year 1305, month 1306 and day1307. The file list 1301 is used as a source at the time of generatingan album to be described later and, when it is desired to display withuse of the album list, the display is realized by reading out the imagedata contained in the file list 1301. The file list 1301 is saved in thestorage unit 109 of the image storage/display unit 102 of FIG. 1.

Shown in FIG. 14 are examples of the file header alone in a table form.

FIG. 15 shows a data structure of an album list 1501 which is made up ofalbum header 1502 and one page list 1503 or more.

FIG. 16 shows details of the album header 1502 which is made up of analbum number 1601, an album name 1602, a page number 1603, a verticalpage width 1604, a horizontal page width 1605, a front cover color 1606and a front cover pattern 1607. The album number 1601 is applied in analbum list generation order and uniquely stored in the imagestorage/display unit.

FIG. 17 shows details of a data structure of the page list 1503. Onepage list 1503 is present for one of pages of the album. The page list1503 is made up of a page header 1701 and a plurality of picture lists1702. More specifically, the page header 1701 is made up of a pagenumber 1703, a page name 1704 and a layout sheet color 1705 with respectto the associated page. The page number 1703 indicates one of pages ofthe album and is uniquely provided in the album list 1501.

FIG. 18 shows details of a data structure of the picture list 1702. Thepicture list 1702 is provided one for each of pictures contained in thepage. The picture list 1702 includes a frame number 1801, a film number1802, a picture number 1803, a trimming start X position 1804, atrimming start Y position 1805, a trimming width (W) 1806, a trimmingheight (H) 1807, a scaling factor 1808, a rotational angle 1809, adisplay X position 1810 and a display Y position 1811. The frame number1801, which indicates the number of the picture to be displayed on thepage, is uniquely provided in the page list 1503. For example, when itis desired to display 3 sheets of pictures on one page, the framenumbers 1 to 3 are given. The film number 1802 and picture number 1803are used to uniquely specify one of the file lists and one of picturesin the specified file list, so that, in the display mode, picture datacorresponding to the picture is read out from the file list. Thetrimming start X position 1804 and trimming start Y position 1805indicate trimming start X and Y positions of the picture in terms ofcoordinates respectively. The trimming width (W) 1806 and trimmingheight (H) 1807 indicate trimming width (W) and height (H) respectivelyand thus trimming is carried out with this width and height startingfrom a coordinate point (X,Y) of the trimming start X and Y positions1804 and 1805. The scaling factor 1808 indicates a display magnificationof the picture after subjected to the trimming. The rotational angle1809 indicates an angle by which the image is displayed as rotated. Thedisplay X and Y positions 1810 and 1811 indicate a coordinate pointwithin the page at which the picture is to be displayed.

FIG. 19 shows a flowchart for explaining how to generate an album list.More in detail, first of all, album generation conditions are set in astep 1901. Corresponding pictures are identified in a next step 1902 onthe basis of the set conditions. And in a step 1903, an album list isgenerated and the generated album list is saved in the storage in a step1904. In a step 1905, it is determined whether the album is displayed ornot. If not, then the system terminates the operation. When the albumdisplay is determined, corresponding image data are read out from thefile lists on the basis of the album list and the album is displayed ina step 1906. When the album display is completed, it is determined in astep 1907 whether or not there was a change in the album list due toalbum editing or the like. Determination of a change in the album listcauses the album list to be saved in a step 1908; whereas, determinationof no album list change causes the system to terminates as it is. Thisprocessing flow is generated to generate a new album when the userselects the album icon 505 of the white shelf-back on such an initial orstart screen as shown in FIG. 5.

A flowchart when an album list is already present is shown in FIG. 20.More in detail, an album list is read out from the storage of the imagestorage/display unit in a step 2001, and image data are read out fromthe file lists of the album list to display the album in a step 2002. Atthe time of completion of the album display, it is determined in a step2003 whether there was a change in the album list due to album editing.In the presence of an album change, the album list is saved in a step2004; whereas otherwise the system terminates as it is. This processingflow is generated when the user selects (clicks) the album 501 alreadycreated in the initial screen of FIG. 5.

An example of how to generate an album list will be shown with use ofFIGS. 21, 22 and 12. In the attribute data shown in FIG. 12, theshooting dates belonging to the picture numbers 14 to 24 are consecutiveso that these pictures can be classified into a theme, e.g., “trip”.Thus, the user specifies the system in such a manner that the pictureshaving consecutive dates from 13-rd are combined and applied withdifferent pages for different dates to generate an album.

FIG. 21 shows a table of a picture list thus generated under the aboveconditions. In this case, 11 pictures satisfy the above conditions andallocated to 4 pages. Slanted areas correspond the ones automaticallygenerated under the conditions and the other areas are filled by defaultvalues.

A page list for the album list of FIG. 21 is shown in a table form inFIG. 22. Page attributes of the page list include page generationconditions, i.e., dates on which the pictures in the respective pageswere taken. Further, the color of layout sheet is default. The pageattribute can be arbitrarily changed. In other words, titles or the likein place of date may be used in the page attributes.

FIG. 23 shows an album header related to FIGS. 21 and 22. An underlinedalbum name, which is input by the user, is used for the display of thealbum and its shelf-back.

FIG. 24 is an example of a contents screen displayed on the basis of thealbum list, in particular, the page list of FIG. 22. FIG. 25 is anexample of a screen when the album is opened on pages 1 and 2, in whichnot only pictures but also page numbers and page attributes are shown.

As shown by the exemplary display screen of FIG. 2, picture images arenot always erected. Such pictures 2501 and 2502 as shown in FIG. 25 maybe rotated in the edit mode after displayed, but this is automaticallycarried out in a second embodiment of the present invention. The secondto eighth embodiments of the present invention will be described butexplanation thereof will be focused on parts different from the firstembodiments.

In the second embodiment, an attitude detector for an image capturingunit is provided in a image storage/display unit so that an attitude ofthe image capturing unit at the time of shooting a picture image isapplied to picture image data as attribute data. FIG. 26 shows a blockdiagram of the image capturing unit in the second embodiment. Anattribute detector 2601 detects an orientation of the image capturingunit when a picture image was taken. The resolution of the attitude isnot required to be so high and thus may be set to have everyabout-45-degree value. An output of the attribute detector 2601 is sentto the storage unit 104 together with an output of the clock 107 wherethe output of the detector is used as attribute data of the image dataand stored therein. Blocks other than the attribute detector 2601 aresubstantially the same as those in the first embodiment.

Shown in FIG. 27 is an example of picture data in the second embodiment.Attribute data include, in addition to the attributes already explainedin the first embodiment, a newly added shooting attitude 2701.

FIG. 28 shows examples of the attribute data in the second embodiment ina table form. In the table, a shooting attitude column 2801 is newlyadded in FIG. 12.

FIG. 29 is a table of picture lists in an album list generated on thebasis of the attribute data examples of FIG. 28. The generationconditions were set to be substantially the same as those in the firstembodiment. Slanted areas are the ones automatically generated accordingto the conditions and the other areas have values by default. Data of arotational angle column 2901 when images are displayed are automaticallygenerated based on the shooting attitudes of the attribute data.

FIG. 30 is an example of a screen when the album displayed on the basisof the above album list and the picture list of FIG. 29 is opened onpages 1 and 2. It will be seen when compared to FIG. 25 that allpictures are displayed in their correct orientation.

After pictures are taken, it is often that the photographer cannotremember the shooting places of such pictures at the time of arrangingthe pictures. Further, for such pictures taken as during a trip are inmany cases classified according to their shooting places or cities.

In the third embodiment, a shooting place input part is provided in theimage capturing unit so that shooting places of picture images areapplied to picture image data as attribute data. FIG. 31 is a blockdiagram of an image capturing unit in an image storage/display unit inaccordance with the third embodiment of the present invention. Morespecifically, a shooting place input part 3101 inputs a picture imageshooting place from outside the image capturing unit and holds it untilthe image capturing unit receives a next input. An output of theshooting place input part 3101 is sent to the storage unit 104 togetherwith an output of the clock 107. When a picture is taken, the output ofthe shooting place input part 3101 is used as attribute data of thepicture image data and stored in the storage unit 104 together with thepicture image data. Blocks other than the shooting place input part 3101are substantially the same as those in the first embodiment.

Referring to FIG. 32, there is shown an example of picture data in thethird embodiment, in which attribute data includes, in addition to thosealready explained in the first embodiment, a newly-added shooting place3201 at the time of shooting the picture.

FIG. 33 shows examples of the attribute data in the third embodiment ina table form, in which a shooting place column 3301 is newly provided inaddition to FIG. 12.

FIG. 34 shows picture lists in an album list generated on the basis ofthe attribute data examples of FIG. 33 in a table form. The generationcondition was set that the shooting place is “Chiba”. Slanted areas arethe ones automatically generated according to the condition and theother areas have default values.

In the case where a plurality of users commonly use a single imagecapturing unit, pictures taken by respective persons are mixed. Inparticular, when the image capturing unit has a large memory capacitycorresponding to several hundred pictures, the mixed picture tendencybecomes strong.

In the fourth embodiment, a photographer input part is provided in animage capturing unit so that an information concerning a person who tookthe picture image is added to the picture image data as its attributedata. Shown in FIG. 35 is a block diagram of an image capturing unit inan image storage/display unit in accordance with the fourth embodimentof the present invention. More in detail, a photographer input part 3501inputs a picture shooting person from outside the image capturing unitand holds it until the image capturing unit receives a next input. Anoutput of the photographer input part 3501 is sent to the storage unit104 together with an output of the clock 107. When a picture is taken,the output of the photographer input part 3501 is used as user attributedata of the picture data and stored in the storage unit 104 togetherwith the picture data. Blocks other than the photographer input part3501 are substantially the same as those in the first embodiment.

FIG. 36 shows an example of picture data in the fourth embodiment, inwhich attribute data include, in addition to those already explained inthe first embodiment, a newly-added photographer 3601.

FIG. 37 shows examples of the attribute data in the fourth embodiment ina table form, in which a photographer column 3701 is newly provided inaddition to FIG. 12.

FIG. 38 shows a table of picture lists in an album list generated on thebasis of the attribute data examples of FIG. 37 in the fourthembodiment. In this case, the generation condition was set so that thephotographer is “Kiyoshi Matsumoto”. Slanted areas are the onesautomatically generated according to the condition and the other areasare set to have default values.

It often occurs that a user misses a good shutter release timing by someof the persons or subjects being shot who close their eyes at the momentthat the user depresses the shutter release or other reasons. In thefifth embodiment, a sub picture image is taken at a time in the vicinityof the moment a main picture image was taken, and data on the subpicture image is applied to the main picture data as attribute data ofthe main picture image. Further, a desired image is selected from themain picture data or from the sub picture data as the attribute data tobe displayed on the image storage/display unit.

Some of pictures are often turned out to be out of focus. In the sixthembodiment, a sub picture image is taken with a different focus at atime in the vicinity of the moment that a main picture image was taken,and data on the sub picture image is applied to the main picture imagedata as attribute data of the main picture data. Further, a desiredimage is selected from the main picture image data or from the subpicture image data as the attribute data to be displayed on the imagestorage/display unit.

Some of pictures are often turned out to have an improper aperture whenthe pictures are closely observed. In the seventh embodiment, a subpicture image is taken at a time in the vicinity of the moment that amain picture image was taken, and data on the sub picture image isapplied to the main picture image data as attribute data of the mainpicture data. Further, a desired image is selected from the main pictureimage data or from the sub picture image data as the attribute data tobe displayed on the image storage/display unit.

FIG. 39 shows a block diagram of an image capturing unit 3901 and animage storage/display unit 3908 in a image recording/reproducing systemin accordance with the fifth, six and seventh embodiments of the presentinvention. In the drawing, more specifically, an image pickup 3902 ofthe image capturing unit 3901 captures a picture image from outside theimage capturing unit and converts it into electronic image data. Theimage data is sent to a buffer 3903 and stored therein. The buffer 3903can store therein a plurality of sheets of picture images. Adifferential operator 3904 reads out the image data from the buffer 3903and performs differential operation over the read-out data. Thedifferential operator 3904 also has another function of merely passingthe image data without performing the differential operation over theimage data. An output of the differential operator 3904 is sent to animage compressor 3905 to be compressed. An output of the imagecompressor 3905 is sent to a storage 3906 and stored therein. A clock3907 and the storage 3906 are substantially the same as thecorresponding ones in the first embodiment. An image expander ordecompressor 3909 is provided in the image storage/display unit 3908.This is because the image compressed in the image capturing unit 3901 isto be expanded or decompressed. The other parts are substantially thesame as the corresponding ones in the first embodiment.

Explanation will be made as to the operation of the fifth embodimentwith use of FIGS. 40, 2, 3 and 39. In the image capturing unit of FIG.3, when the user pushes the first shutter release 303, this causes thediaphragm controller 204 and focus controller 205 in FIG. 2 to starttheir operation, so that the image capturing unit automatically carriesout its aperture and focus controlling operation over a subject.Thereafter, the data is captured into the buffer 3903 from the imagecapturing unit of FIG. 39 at intervals of a predetermined time, e.g.,0.3 seconds. The buffer 3903, which is of a first in first out (FIFO)type, when becoming full of image data, discards the stored data fromthe older image data. When the user pushes the second shutter release304, this causes the then image to be captured as a main picture imagetogether with several sub images subsequent to and precedent to the mainimage. Thereafter, the differential operator 3904 performs itsdifferential operation between the main and sub picture images with themain picture image used as a reference picture image. FIG. 40 is anexample when a reference image and each two sub images subsequent to andprecedent to the reference image are used. More in detail, a referenceimage 4001 corresponding to the main image when the second shutterrelease 304 was pushed as well as an image −2 (4002) and an image −1(4003) precedent to the main image and an image +1 (4004) and an image+2 (400) subsequent to the main image are stored in the buffer 3903. Thebuffer 3903 first sends the reference image 4001 to the differentialoperator 3904. The differential operator 3904 in turn passes thereference image to be sent to the image compressor 3905. Thedifferential operator 3904 then calculates a difference between theimage −1 (4003) and the reference image 4001 and sends its calculationresult to the image compressor 3905. Similarly, the image compressor3905 calculates differences between the images +1 (4004), −2 (4002) and+2 (4005) and the reference image and sends them to the image compressor3905. The image compressor 3905 in turn compresses the images receivedfrom the differential operator 3904 and sends it to the storage 3906.

Explanation will be made as to the operation of the sixth and seventhembodiments of FIGS. 6 and 7 with use of FIGS. 41, 2, 3 and 39. In theimage capturing unit shown in FIG. 3, when the user pushes the firstshutter release 303, this causes the operation of the diaphragmcontroller 204 and focus controller 205 in FIG. 2 to start theiroperation to thereby perform automatic aperture and focus controllingoperation over a subject to be shot. Depression of the second shutterrelease 304 causes the image capturing unit to capture the then image asa main image and also to capture several images subsequent to the mainimage at times spaced by a short time interval as sub images. The subimages are captured into the image capturing unit with their focusesshifted in the sixth embodiment and their apertures shifted in theseventh embodiment. After such images has been captured in the imagecapturing unit, the differential operator 3904 calculates differencesbetween the main image as a reference image and the sub images. FIG. 41is an example in which a main image is used as a reference image andfour images subsequent to the reference image are used as sub images.More specifically, a main image obtained by a depression of the secondshutter release 304 as a reference image 4101 as well as images −1(4102), +1 (4103), −2 (4104) and +2 (4105) subsequent to the referenceimage 4101 are stored in the buffer 3903. Symbol “−” indicates to shiftthe focus or aperture in its negative direction; wile symbol “−”indicates to shift the focus or aperture in its positive direction.Number “1” or “2” indicates the amount of such shift. That is, “+2”means to shift the focus or aperture in the positive direction more than“+1”. The buffer 3903 sends the reference image 4101 to the differentialoperator 3904. The differential operator 3904 in turn passes thereference image to the image compressor 3905. The differential operator3904 calculates a difference between the image −1 (4102) and thereference image 4101 and sends its result to the image compressor 3905.Similarly, the differential operator 3904 calculates differences betweenthe reference image and the images +1 (4103), −2 (4104) and +2 (4105)and sends its results to the image compressor 3905. The image compressor3905 compresses the images received from the differential operator 3904and send them to the storage 3906.

Shown in FIG. 42 is a data structure of the picture data in the fifth,sixth and seventh embodiments. More in detail, the picture data hasattribute data and image data 4201. The image data 4201 containsreference data corresponding to a compression of the reference image(4001 or 4101). Meanwhile, contained in the attribute data aredifferential data −1 (4202), +1 (4203), −2 (4204) and +2 (4205) whichcorrespond respectively to compressions of the differences between theimages −1 (4003 or 4102), +1 (4004 or 4103), −2 (4002 or 4104), +2 (4005or 4105) and the reference image (4001 or 4101) and which are arrangedin this order.

FIG. 43 is a table showing examples of picture lists in an album list inthe fifth, sixth and seventh embodiments. This table is substantiallythe same as that in the first embodiment, except that a display numbercolumn 4301 is newly added. Immediately after the album list wasgenerated, the display number has a default of “0”. That is, this meansthat the main image is to be displayed. However, when the main image isnot well taken and the sub image is taken well, the sub image can beselected. The number of the selected sub image is previously recorded inthe display number column. This example is shown in FIG. 43 byunderlined numbers. When it is desired to read out the above album listnext time to display it, the picture corresponding to not the main imagebut the sub image is displayed.

Pictures processed by the system are still pictures. However, when theambient sound at the time of shooting the picture or a voice comment isapplied to the picture, this causes the picture to be more impressiveand fascinating. In the eighth embodiment, at the same time that apicture is shot, voice data in the shooting place are also recorded attimes in the vicinity of the shooting time moment and applied to thepicture image data as attribute data of the picture image. When it isdesired to display this picture image data later, the voice data as theattribute data can be reproduced.

FIG. 44 is a block diagram of an image recording/reproducing system inaccordance with the eighth embodiment of the present invention. Morespecifically, an image capturing unit 4401 includes a microphone 4402which captures external voice and converts it into electronic voicedata. The voice data i sent from the microphone 4402 to a buffer 4403 tobe stored therein. The buffer 4403 can store therein voice datacorresponding to about 10 seconds of voice. An output of the buffer 4403is sent to a storage 4405 together with image data received from animage pickup 4404 to be stored therein. The other parts aresubstantially the same as those in the first embodiment. A voice outputpart 4408 is provided in an image storage/display unit 4407. This is forthe purpose of reproducing voice data. The other parts are substantiallythe same as those in the first embodiment.

Explanation will next be made as to the operation of the eighthembodiment with use of FIGS. 45, 3 and 44. In the image capturing unitshown in FIG. 3, when the user pushes the first shutter release 303,this causes voice 4501 captured by the microphone 4402 to be sent to thebuffer 4403. The buffer 4403, which is of a FIFO type, when getting fullof image data, discards the image data sequentially from its older data.Depression of the second shutter release 304 in FIG. 3 causes the imagecapturing unit to capture the shooting picture image and also the voice4501 of several seconds later. Thereafter, the voice 4501 before andafter the picture shooting time moment is fetched from the buffer 4403and sent to the storage 4405 together with the image data.

FIG. 46 shows a data structure of picture data in the eighth embodiment.The picture data has attribute data which contains voice data 4601.

FIG. 47 is a table showing an example of picture lists in an album listin the eighth embodiment. The other data other than a newly-added voicedata column 4701 are substantially the same as those in the firstembodiment. When the album list is generated, the system examines thepresence of the voice data. In the case of the presence of the voicedata, the system puts “1” in the voice data; whereas in the absence ofthe voice data, the system puts “0” in the voice data. When it isdesired to display the album, the system examines the voice data column4701 and can reproduce the voice of the picture having the voice data.

In this way, the first to eighth embodiments can be carried outrespectively independently or in combination.

As has been explained in the foregoing, in accordance with the presentinvention, there can be provided an image recording/reproducing systemwhich allows easy arrangement and keeping of picture images and alsodisplay of such picture images for appreciation. There is also providedan image recording/reproducing system which can minimize shooting missof picture images.

What is claimed is:
 1. An electronic image capturing apparatus includingimage data recording means and image data displaying means, said imagedata recording means comprising: an image extracting means forconverting a captured image to electronic image data, a first storingmeans for storing said image data; a differential processing means forextracting differential image data from a comparison between said imagedata stored in said first storing means and reference image data; animage compress means for compressing said reference image data and saiddifferential image data; a capturing control means for controlling saiddifferential processing means and said image compress means at least onepredetermined time interval when capturing is executed; and a secondstoring means for storing compressed reference image data and compresseddifferential image data which are related to each other; said image datadisplaying means comprising: an image expanding means for expanding saidcompressed reference image data and said compressed differential imagedata; and an image displaying means for displaying original image datagenerated from said expanded reference image data and said expandeddifferential image data.
 2. An electronic image capturing apparatusaccording to claim 2, said capturing control means further comprising achanging means for changing a capturing condition including an irissetting and a focus by each of capturing.
 3. An electronic imagecapturing apparatus including an image data recording means and imagedata displaying means, said image data recording means comprising: animage extracting means for converting a captured image to electronicimage data; a first storing means for storing said image data; adifferential processing means for extracting differential image datafrom a comparison between said image data stored in said first storingmeans and reference image data: an image compress means for compressingsaid reference image data and said differential image data; a capturingcontrol means for controlling said image compress means at at least onepredetermined time interval when capturing is executed; and a secondstoring means for storing compressed image data related to each other;said image data displaying means comprising: an image expanding meansfor expanding compressed said reference image data and compressed saiddifferential image data; and an image displaying means for displayingoriginal image data by expanding compressed said image data.
 4. Anelectronic image capturing apparatus according to claim 3, saidcapturing control means further comprising a changing means for changinga capturing condition including an iris setting and a focus by eachcapturing.